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/ 1. ^NTROD|p:TION 

■ . ■ I I . 

' RareliP'^^doesV^ociety -have a conscious opportunity to choose lts<future 
elite. 9^edltary advantages of property, culture, and genes are not distri- 
buted -Recording to social choice. It Is true that many governmental actions , : 
can affect the distribution of wealth, but seldom (outside (of revolutionary 
'societies) do they become a policy for Installing a chosen few In privileged 
positions of Income and Influence. 

There Is, however, one well-accepted, conscious policy, for choosing the 
elite. It is the selection of those who will receive higher education and 
professional training at public institutions .-^Most countries endorse ad-;^ 
missions policies that select the "most qualified" students. This criterion 
often includes characteristics like intelligence, creativity and motivation 
but does not explicitly count attributes like social class, skin colour, and 
;L6rigin. In practice, extraneous factors may enter, for good 
^ But throughout most of the world' and in Pakistan, the 
cy of admission to higher educatioh~one might say, the Ideology 
of admission— stresses merit .. Given that jrjot all, may be trained, those 
trained should be the best; those with m^it should be chosen as the next 
generation's elite. V 

This said, one quickly notes that the highly educated and tbe^oclo- 
economic elite are not coextensive .groups; A University degree is neither 
necessary^ nop sufficient for becoming rich and powerful. Admissions policy 
"ls;;>notV perfectly effective means of choosing the elite. But income and 
years of education are positively correlated: Doctors, engineers, and 
phamtacists do usually dccupy high positions on the socioeconomic scale. ^ 
Admissions pplicies have an important, if not exclusive, effect on the 

' ■''"Good reason?" might include admitting some less qualified stu.dents from dis- 
advantaged baclc'grounds or f'rom oppressed races. "Bad reasons" might . include 
admitting a coiisin of a politician for this reasons alone. 

^Sfu^ents of Pakistan's ecofiomic elite have demonstrated^ that many of .the isuper 
rich had little formal education. See, for example, Gustav Papanek's work on 
the very rich in West Pakistan (in Pakistanis Development Experience II / 
jCambridge, Mass., Harvard University Press, 1970.) , ' 

. ' ' ■ \' ■ - ■ *■ ■ \ ■ ' ■ . - . 
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allocation of human re^urces and, in'turn, on the allocation of" status and 
wealth in the society. ; 

In most countries, it is the State that sets admissions policies;^ ^nd 
inmost countries, those policies must be very selective. Few developing 
countries, in particular, feature privately nm Universities and professional 
schools. Selectivity is necessitated by the large^' number of candidates for a 
few educational slots. The demand for higher^ducation and professional 
training is large and growing throughput the ^evelop^ng world. > / • 

In Pakistan, tooi Universities and professional schools are' under govetn- 
mental control. The State has tl\e ultimate responsibility for deciding how many 
seats will be provided and to /whom, although in practice the technicalities of , 
'admissions policies may be left to the discretion of the institutions involved. 
And admissions policies bind. Only abofit a tenth of the applicants of Karachi's' 
Institute of Business Administration can be admitted. The corresponding. frac- ; 
tions'for other professional schools at the University of Karachi are almost as 
•low. The faculties of arts and of^ science are swarmed with applicant^fo^ 
^Bachelors* and Masters' degrees'. Were it not for the deterrent effeV^ 
mii^mum required scores on the .intermediate examinationis the demand for seats . 
would be even greater. • ^ 

The social costs of admitting the wrong students are high. The government 
pays over 90 perdent of the social cost of a student's higher education. The^ 
i State thus has an important stake in whether a student completes his/her training 
or not. Failure rates are high: 26 percent^in engineering school, for example, 
and 37 percent in medical school. 

Admissions policy has two dimensions: how many, and who. We confine 

• ourselves to the second dimension. We shall' not consider the optimal aggregate 

• \ 

numbers of doctors, engineers, and M.Sc's to be trained annually; what we care 
about is, giv^ those numbers, just who is selected and why. 

How tfoes this important* public policy for selecting the elite actually . 
work? What is the operational 'definition of "merit''? How valid is it? These 
questions are clearly important for policymaking*, since selection of future 



. .^For a summary* of recent evidence, see Edgar O. Edwards, ed.. Employment in 
Developing tiations . New York, Columbia University Press, 1974. 

A ' \ ^ ' y ■ ' - V 

At l^ast a s^^ftpd-divisidn ^ntermedia^ result is re<iuired at jnost -institutions , 
which precludB8\ftpplications.^by the large numbers^f graduates with third- 
divisions and. passes. ^ % ' 

^Based on 1974 ^^ta from th^ N.E.D. Engineering Sdhool and the Dow Medical - 
^gchool. Mpre on this matter appears below. / .'^ 
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prof essionalfe and^ lntellectuals^involv.es both economic' efficiency and social 
'equity. They are alsp ^ important in a broader understanding of contemporary. 
Pakistan:* we may find clues for conjectures about the role of "meritV in 
economic and social life. . ^ 



The Case for ^^erit" • ] l\ 



" The affiliated institutions of the University of Karachi base admission on 
intellectual merit. The details are reported elsewhere^; only the broa,d- f ea- • 

tbres matter here: ' ' * *' 

*"-»'», 

o A student 's^nterAediate score, b^sed on a test* taken after 12th ' 
grade /Is the most important, and in some 'cases the sole^ criterion 
for admission. 

* ^ o Oecasionaliy , very superior performance on th^J.Oth-grade Matriculate 
test will be considered as % positive factor. 

o A few sea'ts are reserved for students from^fa^r-f lurfg areas, from 
scheduled' castes, with athletic talent, or with a parent on the 
University faculty. ' . ' 

o Only in the case of the Business School are interviews used and 
firude IQ tests employed. ^ ' 

.The use of \intellectual mertt^^as the criterion for admission can be • ^ 
defended in vaTiotie ways. To our knowledgd", however, no explicit formulation 



of the reasons fdr this criterion has been made in Pakistan. PefRaps this cri- 
terion is isimply obvious to all concerned parties, '^ut in view of the impor- 
tance 6t the topic, it Is worthwhile to try to specify, the obvious and to 
examine the Gonvemtiqjnal wisdom. V 

What we.shaV call^ the "strong a^ument" f or^ the mertt criterion depends 



on predict'ive validity . A test' is said to have predicti;^e validity if scores 
on it correctly anticipare future results of interest. Thus, Inter marks. have 
pfedic^ive validity irf xney can predict who will'do well and who will do badly 
at higher levels of education. ^ ' . 

• The strong argument proceeds as 'folios. ^ First, it is important to anti- 
cipate who will do well An higher education. Failures are socially expensive, • 
since the cost pei; year for a University student ip Pakistan is almost 150 times' 



^Klttgaard, et al . Choosing th^ EliZe ..., pp.' 3-111 



as high as the cost for a primary /school 'student , and over 90 percent of the 
costs of higher educati-on are bor^ie by the/State* 

Second J success in higher Education i^ a positive function of "ability." 
Those with more' ability have a 1/ower probability of failure. There is also a ^ 
positiv^jSide. to. th9 need for prediction:, those with greater ability will *^ 
reap more' from the educational ^experience, and they will therefore be of taore 
use to the nation after graduating. * " ^ * 

Third, the operational criterion of mei;it~examination scores — are positive- 
ly related to ability, and therefore examination scores can predict who' will 
si^ceed and who will fail*. 1 ' • 

The' strong argument "^nayj be supplemented by other considei;ations. and may. 
also be attacked in a. number ii^t grounds. For now, we note that the strong 
argument depends on -the predictive validity of the criteria of merit. If 
examination marks are relatively poor predictors of University success, pre- 

ecomes^ hopelessly weak, 
i ■ • 



sumably the strong argument 
The Strategy and the Data 
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* • Do students* scores oA Intermediate examination foretell their later ^ 
University success? • If Intur marjcs (1) are a predictor of University performance 
(P), we expect the correlation between them to be positive dnd statistically 



significant. As I^ goes up. 



we expect P to go up. More importantly, i^ I.'^is 
to be the sole criterion fcr admission, we might think it reasonable ta expect 
that variations in I^'^shoulc explain much of .the variation observed in P. 

We also tried to' disc over whethjer other possible indicators ^of intellectual 
merit' were accurate predict ors. When possible, we examined the effect on 
* University performance of supposedly ^extraneous" factors — such as sex, rural ^ 
or urban residence, father s education, possession of a telephone,* and'^primary 
school *s medium of instruction. 



^Estimates from the Minis t:y of Education e4timates annual costs per student as 



follows: ^ 

Development il' Recurring 

Expenditur e Expenditure 

Primary 38 100 

Secondary 270 • 350 

University 15,000 . 5000 



Reform and Research Sector 



Total 
138 
620 
20,000 



Based on 1973-7$ figures; Development x>f Education in Pakistan , Examination 



, Curriculum Wing, Islamabad, September 1975, pp. 5, 25. 

t- ■ ■ ' • 



As'wlll l3§comeL_eyident , the data we analyse are not as extensive or as de- 
tailed as we would wish. Each data set* was* laboriously ' assembled, often from un-' 
tabulated sheets, and each has its limitations, be it saiQple size or the number 
of variables on-whlch' itif ormation is available. However, the data we analyse ^ 
are accujatej and in each, case we are ablg to quantify tlie predictive validity 
of ' the current criteria 'of. merit . * - 

, . . ' . - ■ ■• 

Pharmacy, MedAcine, and Engineering . • * , 

' ■ ' ^ \ ■• . ^> • . • ^ ^ ■ ' ^ ■ ' . 

r In these three professional pro-ams,' the Intermediate score is the sole 

admissions criterion for twelfth-grade applicants. How well does this score 

"predict" a student's eventual success? , , ; 

To find out, we collected information on groups of recent graduates: ; 

o For the pharmacy school, we obtained data for 110 gt^d^ates" of the 

class of 1974 oh final pharmacy jnarks (P) , Inter marks (I), and / . 

matriculate marks (M) . . ' 

o For the» Dov medical school, we collected data on 89 students whp 

' . ' Appeared in the final' prof essional M.B.B.S. examination IS 73, , held 

* " in February 1975.^ The information included medical ' score (Medic),, 

* ► 8 

I^, M, sex, and- residence in Karachi or not (K) . ^^ * ^ ^ 

/' o For the N.E.D. engineering school, we assembled cfata on 186 students- 

who appeared in the B.E. examination 1972,. held in 1973. The variables 

were engineering scare (E) , specialty (exectripaT, mechanical-, or 

8 - ^ ' ^ ^ 

civil engineering), 1, and M. - 

We examined these data with regression analysis as our main statistical topi 

Current admissions policies assume performance '=^(1^) , where f is monotonically 

increasing. .Since we had no a priori notion of the exact functional form (linear^, 

logarithmic-, quadratic, etc.) nor how other variables should bd taken into account 

we used regression as an exploratory tool. We began with a. linear model, and 

then, after examining residual plpts, we attempted what, spemed to be more suitable 

i . • / , 

specifications. 



For medical and engineering students who failed the examination--37 percent of 
the medical students and 26 percent of the engineering student s^^-no illarks are 
given, just a fail. We coded the failures as the maximum failipg score, 49 marks 
for medicine and 45 maVks for engineering. 

■ ■■ ' • ■ s 



Table 1 gives the results of^ simple linear regressions, with Inter marks 
as the.independent*variable. J . ' \ • - 



' • Table 1 " ^ 

•» ■ ' 

SIMPLE REGRESSIONS FOR PHARMACY, MEDICAL,' 

AND ENGINEERING SCHOOLS 



■I , 



Score 


Constant 


Intjer Coefficiertt 


n 




's.e. est 


,P 


322.9 


'• . * ° ■ 

^ ^ 0.31: . 


- 110 


0.15 


.34.. 4 






(4.4)** 








Medic 


38.1 


" 0.33' , 


99 


.0.16 


" . 7 .0(5 






■ (4.2)** 








E - 


37.0 


0.39 


X 186 ' 


0.055 


V ' 10.-87 






(3.4)** 









^ Note: Figures in parentheses are ^-statistics'" 

** in3icates significance at the c^^ 0.01' level . . • 

■ ■ '■ ' - v 

Residual plots for pharmacy and for medical school drd' not irldicate curvi- . 
linearity, and -alternative functional forms (logarithmic apd quadratic, for: . 
pharmacy;- logarithmic for ^medicine) *did not perform better than the simple linear 
(equation. For engineering school, howejTer, scor.es of rae plot ^±n ^Figure 1 

' " ■ • ' ■ ■ ^ • ■ ■ U " . f ' ■ 

indicated a nonlinear relatipnship^ between E-and I^; ±n later regressions on E, 
*we attempted to 'fit ^ quadratic function. • , \ - ^ - 

' ' ^ Several findings in Table* 1 stand out. Firsts the regression ^coefficients j 
on . I are similar in the three equations. A .student , with a ten-point , higher Inter 
score is pi&edicted. to have about a three- oV 'four-point higher score* in pro- 
fessional school. 'Second, the t-statistics are all statis^tically significantly 
significant beyond the c<. = 0.01 level. That is, E and are significantly cor- 
related, as expected. . o \ 

^ But, third, the percentage of variation explained by I is uniformly low' .. 
(This* fact is especially true -for engineering school, because of the nonlinearity^ 
just noted). Most of the- variation in professional school performance could not 
be statistically explained by Intermediate scores. , , 

We can put this surprising and important finding another way. Within the 



^Note that the pharmacy equation defines both dependent and independent variables 
as 10 t;itnes the percentage score — these are the so-x:alled "marks" — whereas, in 
'thfe e'quations for engineering and medicine, percentage scores are used. 



- •• ••• . ■ . 

range of sQires^xainJned here, a student's Intermediate score isVnot a- good 
predictor*wr his or her later success in pharmacy school. For example, take a - 
student with an intermediat^score of 531^ "^Our best guess- of his subsequent 

pharmacy, score isc490, but there is a 33 percent chance that the true score 4^ 

* " 10 ' * 

ourside ^he rather large range of 455 to 524. Notice that the* standard 

^ * J . 4 ji ' ' , ' * « ■ ^' • 

deviation of P is 37.3; the' standard error of our estimate of knowing'^ 

is 34.4, which is ./a "reduction in oiir uncertainty" of Jess than 8 percent. 

One might think that /if an applicant's matric scbre (M) were also taken 

into account, om could make a better prediction of P. With this • thought in 

mind, numerous multiple regressions were run, using residual analyses to. help 

• - . ■ 2 

discover the "best fit." The coefficients of M (or were.^ever statistically 

nificant at the 0.05 level, except for medical school. Moreover, the percentage 
of variation explained rose only a little.* Even with intermediate and matric ^ 
scores used simultaneously as predi6tors, vfery little of the variability in 
pharmacy scores can, be explained . ^ ' • ■ 

Further analyses (reported in the monograph Choosing the Elite .. Q looked 
at different dependent variables ^including a binar^j variable, pass or fail)- and, 
additional independent ^variables (including sex, residence, and father's educa- 
tion) . None of.the^e elaborations altered the basic finding: measures of 
merdt currently used have little predictive .validity. 

The Business School ^ ' 

Our statistical explorations on a richer data set for the Institute of 
Business Administration followed the same strategy: using plots and residual^ 
. analyses from numerous multiple'' regressions to give "merit"' every chance to 
"show .its predictive, power. The results are presented in detail in our mono- 
graph: >asically, they showed that none, of the indyependent variables reached 
Statistical significance at, conventional levels. ^ / \ 

'The Faculties of Arts and" of Science / / ^ - 

■Qur richest data set and most exhaustive work concerns admissions to the 



"""^That is P+ standard error of the estimate is 490 + 34.4 for 1 = 531. Our 
95 percent confidence interval on P give;n I = 531 is 490 + 68.8, or from 431.2 
to- 558.8. ' ^ 
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University's Faculties of Arts and of Science. A stratified sample of 2786. * 
students was selected »froin-the d'ass of 1971 in a. remarkable data gathering 
effort by Rabia Rafj^i from the University's own records. Available variables 
included division oblfained fromjthe University in 1971 (i.e., first, second, 
third, pass) , Inter division, matriculate division, sex, certainrgrbxies for 
socioeconomic status (father's education, has telephone or not) ^ and an indica- 
tor of command of English, (medium of instruction in the student^ s primary. 

' ' ' . " ' >.....'' ■ ■ ^ 

school) . ' * ■ V V 

Important statistical problems emerge witlv^ the discrete 'dependent • 
variable and some ordinal independent variables: space does not allow an 
elaboration of the -probliems or^ our solutions, to them. Neither shall we 
'detail Kere our elaborate statistical explorations* of these data. 'Table 2 
provides a sort of bottom line: a qualitative summary" of' our "best" equations 
for different subject areas. " ' i • 

Table 2 ' . " 

PREDICTORS FOR DIFFERENT SUBJECT AR^^ * 

. ■ ■ ! ■ ' ' . . 

• ' I Predictors ^ 



Subject 


N 


--Int 


. Mat.^ 


! Sex. 


Medium 


• -<i^.Ed. 


Tel. 








All arts 


1160 




n.s. 


■ * 


* 




n'. s. 


0.09. 


27 


.13 


All science 


423 


' n.s. 


* 


■ n.s. 


n.s. 


n^s. 


* 


0702 • 


■ 5 


.22' 


Engineering 


- 33 


n.s. 


n.s. 


n.s. . 


. ^ n.s. 


/ n.s. 


n.s. 


0.26 


1 


.93 


Education 


66 


n.s. 


n.s. 


n.s. ' * 


n.'s. 


n.s. 


n.s. 


0.04 


.2 


.02 


Commerce 


204 


. * 


n.s. 


n.s. 


n.s. 


n. S.- 


n.s. 


0.07 


15 


.15 • 



Note^ * signifies significant at the .0.05' level with the ' 
• anticipated slgtl (including that girls do better Chan boys) ; 

n^s. signifies not significant. The Commerce equation used 
logarithms'?^ all divisions. » 

The low percentages of variation explained by these regressions reinfdrce 
' .1 . ^ . V ' 

the^esults from the professional schools. FurthermoTBV^ot only does the cur- 

rent criterion of merit (Inter scotes) statistically explain very little of^a' 

studejit^s subsequent University performance': even after including matric 



ee Choosing the Elite. 



pp.' 24-31 ; 
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division, QEathet's "education, «ex*^prijnary. school medium, and possession; of a ^ 

* ' ' ' . > ■ ' , ' y.-ff , / 0. '•■ J ■ ' ■ * * 

telephone as independent variables, the regressions have little predictive • 

.J • T- ■ .. • . _ .f . : • • . . - ^. ^ • ■ 

• . • ' , ' ■ " ' " V-^ • * ' 

Explanations^ • ^ / • 

* « ■ • • . . 

There are several possible interpretations of these results, the moist 
economical,' perhaps, is that the "strong argument" is false: Inter and matric 
. scores have poor predictive validity. To uise such scores as the sole basis for , 
||(choosing the elite might there^f ore seem unwarranted , even if .one accepts th^ 
strong argument's premises about the need fgr predicting who will do well. - 

A second explanation focuses on* the lack cjif reliability of both Inter 
aftd University marks'. • Marks are subject to sevetJl kinds of unreliability, 
^dne has' to do with tha differences between graders. Neither jnatric nor Inter 
exams are "objective" in the sense of multiple choice or true-false questions. 
Different graders mark different tests, and despite guidelines for grading test 
questions, no two graders mark exactly alike. As described^in a forthcoming 
istudy, a sample of graders of \he matric exams were randomly selected and asked' 
to score exactly the same examinations. T^e correlat^ns between the scores^ of 
different graders for the same examinations ranged from' 0.2 to 0.9, within 
average of about 0.7. - * . _ 

>>L^ We suspect a similar lack of perVect' reliability fgr Inter 'marks. .Uni- 
versity and professional school marks are probably somewhat more reliable, but 
not perfectly so. At lea^t part of the reason for thd lack' of strbug correla- 
tion betweeru Inter and University marks stems from the unreliability,, rather 
than the invalidity,,^ of marks. However, this is scant comfort for the strong 
airgument. f Mathematically, the validity of a test cannot exceed the reliability 
squared; and^what matters fo» th^^trong argument is how well Inter exams 
p^edictiUniversity performance. If thfe^answer is 'Wt well," it hardly matters 
wh^t'we call the reason. ^ ' " ^ ^ ' 

A third possible explanaticfn for our findings weakens the defeat of the • 
• strong, argument. ' The multivariate analyses reported aboye were based only on 

students who actually did secures admis^sidn. 'The" resulting' restriction in the 

".•■•"•■'•"■* '12 ' ' ■' ' 

range of talent attenuates correlations. Our best guess, based on a study ^. 



See, for example, Robyn M. Dawes, "A Case Study of Graduate Admis^ilons: 
Application of Three Principles of Human Decision Making," in William B. 
Fairley and Frederick Hosteller, eds. > Statistics and Public Policy ,, Reading, 
Mass., AddiW-Wesley, 1977, pp. 295-308./ . . . 



of^the Business School and the opinion of Unlyersky^rofessors, . is^Jthat the 
regression lines we found wuld be accurate throughout the second-divlsioners 
but woul^d fall off in the middie 300's and-below.'''^^ Therefore, we believe that 
the strong argument is weak for most of those who would even consider applying 
to the Uniyersity. - , 

Beyond These Data: The Pros and Cons of Merit . 

Marks may not h^ye much predic.tive powe^, hut disproving the strong 

argument is not sufficient to reject a merit-based admissions policy. Nor is 

the validity of the strong argument necessarily a convincing reason for accepting 

merit-based admissions. Marks have other functions in the educational system 

besides predicting who will do well in higher education, which may be 'important - 

. ' -0 ■ ^ ■ ■ * ■ . » 

enough to justify using marks as the basis for admissions. ^ \ 

Creating Incentives 

A point of departure is to note that marks provide an incentive to students 
at lower l-evels of education, in part because the marks are used as the criterion 
for admission to higher levels. Students therefore in^^est their energies in the 
procurement of marks, which in turn presumably increases the amount they learn. 
(Shortly we shall consider the pos$ibility of adverse incentives generated by 
marks,) Apart from their possible predictive power, high school njarks also 
have productive , power, in terms of invoking certain behaviour at pre;pUniversity 
levels of education. 

Presumably, eliminating marks as a criterion for UMversity admissions " 
would also reduce their power to motivate high school students. sMany college 
teachers and educational officials have expressed to us the importance^ of this 
incentive. "If we ^ot fid of marks,". one said, » "my students would do no work., 
at ail." Marks are said to motivate students for two reasons: first, to . 
graduate from high school; and second, for many but not all, 'to qualify tor ^ 

''"^Some old data^from the Institute of Business Administration^ shows that 'the - 
probability of completing IBA successfully was higher for third-division B.Sc.; 
graduates than for first-division B.Sc. graduates. (For B. A. -holders, the 
"^.situation was reversed.) From the large data. set on the University as a whole. 
It was found that the probability of securing a first-class degree given that 
on'e had a first-class Intet score was 0.13. For those having second-class 
Inter scores, the probability of a University first division ^was only slightly, 
lowers 0.11. But for students with third-class Inter scores* the probability 
of securing a first-class University degree dropeed to only 0.03. (West 
Pakistan Institute of Management, "A Study of Significant Aspects of Success 
and Failure Among I.B.A. Candidates: 1962-66," processecj^no date). 
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higher education. E^%en if 'marks could be shown' to have no predictive validity; 
most teachers would probably oppose the abandonmenf'of marks in admissions 
policy, because of the productive power of marks^. . ' . 

This *|*roductive power, however, is sometimes ufeed as an argument against 
marks. Critics contend that marks provide adverse incentives outweighing the 
good ones: students invest too mcuh' time in the wrong kinds- of learning 
activities. Michael Spence exp^lains: ^ 

I . 

From reasonably early ages, students are guided through 
courses of study designed to make thfem look like good bets 
(lotteries) to colleges. The expenditure of sjtudent effort, 
and the concomitant anxiety over a long period, may constitute^ 
a large diversion of human resources and energies^^way from ^ 
relatively productive activities at earlier ages. 

Spence goes on to show, with plausiblep!tifeoretical' models, that students' 
overinvestment in marks-producing behaviour may distort the predictive or sig- - 
^i>alling ■ power of marks, thus addling another overlay of inefficiency to the 
Situation. . - ' « ' ' \^ 

What are the facts about overinvestment in Pakistan? Matric and Inter 
examinations that-determjlne marks are said to stfess^^the wrong things and to 
malfe students do so, too, A 1956 report by the Board of Secondary Education 
in Lahore did not mince words: 

The dead weight of the examination has tended to curb the 
teachers' initiative, to stereotype the -curriculum, to promote 
V . mechanical and lifeless methods of teaching; to discourage all ^ 
spirit of experimentation and to^^^lace the stress on wrong or 
unimportant things in education. 

A*Haque concurs: ; ^ 

-Not only pupils but teachers are affected by the present system 
of examination... Examinations dictate curriculum instead of ^ ^ 

following it, and hamper^the prjgei^^ treatment of the subjects and 
sound method of teaching (sic). 



^ ^Market Signalling: Informational Transfer in Hirin^nd Related Screening 
Devices , Cambridge, Mass., 1974, p. 80. - ^ ' 

^^Board of Secondary Education, Report oa Secondary Education , Lahore, 1956-, 
p.- 19. 
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"Examination System," Pakistan' Education Review, No. 1 January 1970, p. 98. 
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Mohammad Basharat All ^believes that making marks" a less impor^tant factor in 
'admissions policy will have favourable results. His opinion is worth citing 
atlength. * » . • ' • 



The results of any*pubiic examinat^n at the end of any stage 
l;lke SSC, ITSC, etc. should^ not be treated as 'passport' for a4mission ^ 
.to the next higher stage. There must be arrahgements devised at any^' 
academic stage for selection/rejection of students. This gives, the 
academic institutions opportunity to screen students the way they. want. 
' . It_ also furbishes the students with the understanding t;hat the result of 
[ ^ amy public examina^tion is not all that they should have to do with but 
, they may face othe^r. trials tocgef into the next academic ^programme. • 
This will surely cut down mych of the unusually wrong and ,pemicioui5 
attitude sustained by the students towards final examinations. 

Expert ^pinionsr like*^ these notwithstanding, hard evl.dence on issues of . 
ov'erinvestment is not plentiful. Much anecdotal evidence, indeed, indicated 
to us that students are underinvesting in st;udy at all levels of education in 
Pakistan. ■ \ - • • . , " 

It is worth distinguishing the productive power of th6se examinationsr 
and this system of marks from that of an improved examination system. If the 
choice is between the current system and one that grants marks much less a role 
in the admissions ; process, one might favour the latter. The current system 
may have low predictive and low productive value. But a preferred alternative 
might be the installation of multiple-choice' exams that; stressed understanding 
and problem-solving, ability , that were graded quickly to save- the months of 
wasted time in ^the current system, and that were tightly supervised to alleVfat 
cheating. Such tests might have higher predictive validity for Universi/y 
admissions purposes. But even if they did not, tj^e point' is that test/ with 
. good incentive effects might still, be made a part of tHe admissions process. 

"At Least Marks Are Objective" - 

Another defense of a marks-oriented admissions system is worth mentioning 
To highlight the argument, suppose that mark^ have no predictive power or pro-, 
ductive power. Even in such an unfavourable ^circumstances, marks-based ad- 
missions might be defended on the grounds that the altemativies are even worse. 
"At least marks are objective," the argiment runs, "or are perceived to be 
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"How Objective Are the Objective Tests," Pakistan Education Review , . No 4 , 
O^ctpber 1970, p. 35. > ' - ' ' ^ 



, objective. . policy that foregoes tesis iri favour of theoretically more 
valid predictors (and better incentive-creators) that are subjective — such ^ 

o . 

as teachers* evaluations or interview ratings — would open the door to corrup- 
tion. In Pakistan, influence would end up dictating admissions, an^ that 
^ outcome would be worse for society." 

This, argument has a certain conceptual attraction. If examination scores 
were mer61^ random, theymight be preferable tg^a^ subjective system that created 
a dynamic of overt corruption and "sifarish." Th^^xamination system is stable, 
in place, and accepted by all as a legitimate fheatis of selection. It can be , 

argued that any less rigid and formal system would be. perceived as- illegitimate 

* ' * ' - 18 
and, in contemporary Pakistan, would in fact end up .being illegitimate. * 

Merit as Ideology • • . 

But the issue of perceived legitimacy raises broader questions. If 
"merit*' as currently defined is not predictively valid, then might a merit- 
based system be illegitimate? ^ 
* To oversimplify for the sake of clarifying the 'point, suppose that marks 

are not randomly distributed across > social classes, ethnic groups, and geo- 
graphical regions. Thus, mai:ks are not correlated with later academic per- 
formance but are correlat;^ed with socioeconomic variables. (For example, 
upper-class, urban students may do better than lower-clgss or rural students; 
jjEnglish- and' Urdu-speakers may do better than Sindhi- or Baluchi-speakers.) 
Then admissions policies would discriminate against some groups, despite the 
fact that "merit" does not predict ' those who would do well at the University. 

On this view, we might reject the "legitimate," accepted admissions system 

19 

because of its patent unfairness. 
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Merit criteria are also sometimes defended for their own sake. One may 

simply believe that it is right to reward those with the highest scores on 

matric and Inter exams — regardless of predictive validity or incentive effects. 

19 

This rejection o^ a merit-based policy might hold even if marks were 
epccellent predictors of U^niversity performance. The point is that the fairness 
of the admissions policy must be tdken .into" account, along with predictive 
power, incentive effects, and (perhaps) the advantage of perceived legitimacy. 



The. argument could be pushed even further. Admissions policiesybased on 
..'* '* ' ^ * 

the ''ideology .of merdt are jnerely anua'ttempt to legitimize social inequality^ 

^ ■ »■ . * , ^ ^ •* 

the argument might run. In P^istan, the social .gaps are huge between bosses 

and suboxdinates, between white collar and blue, and even between various 

levels of the same or^nization's hierarchy. Such gaps can only be maintained 

by force "^or by custom — or by the geiieral belief that inequalities of power and 

privilege are somehow the result of "meri^t." If it is shown -that "merit" in 

fact has 'littlepredictive power, then^the entire ideology of "merit may '.be 

■ ^ ^ " . . . /V . , ' ' 

called into question. , 
< ■.■•». 

. ^ Even In the United States, wherp educational research is, abundant, these 

20 

issues are not yet settled. In Pakistan, there is very little^ information vn 
the relationship of marks or educational achievement with later socioeconomic . 
.^success, or on what traits schools produce or reward. There is little doubt 
that inequalities exist in Pakistan, but it is also true that most of the people 
at' the very top of the power pyramid Jiave little f oi^al education. 

Dimensions of the Policy Problem 

Thi% lack of inforrmation does not necessarily preclude a cons'idered 
opinion.- Since the ^issue of admissions, pdli<:y is so important, it can be argu^ 
that calmly to await further research would be socially irresponsible. However, 
a lack of research does limit the scholar's role in forming that opinion. It is 
perhap^ as much as one can do to recapitulate some of many dimensions of the 
problem. . • « 

o Predictive validity of marks ; Does the admissions system economize 
social costs of education, by admitting tho^e most likely to succeed? 

o Incentive effects of .admissions policies : Are the effects, on high 
school students positive or adverse? 
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Samuel Bowles .and Herbert Gintis arguie that American analogues, to "marks" 

do not predict post-schooling success but merely TTQinforce the prevailing 

hierarchy. Schooling in Capitalist America , New York, 1976, esp. pp. 103-7. 

However, David Wise shows that when a properly sophisticated model, is employed,. 

University academic success does, independently predict later socioeconomic 

success; Zvi Criliches (and others) .demonsjtrate 'how difficult . the empirical 

estimation of educational returns becomes in the face of umneasurable "ability" 

variables; numerous evaluations of educational programmes for students with low 

IQ spores hav§ shown little impact j3n measurable learning. (Wise, "Personal 

Attributes," Job Performance, and Probability of Promotion," Econometrica , Vol> 

43, No. 5-6, Sept. -Nov. 1975; Griliches, "Estimating th^ Retu;:ns to Schooling: 

Some Econometric Problems," Econometrica.) 
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The legitimacy of marks ; Are marks worth rewarding for the^r oWn 

21 ^ ■ ^ • 

sake, or simply "because /)f their aura of legitimacy In a country 

where corrupDlon is rampant? Are mapks the best we can do, even If 

they are highly Imperfedt? ^ < 

Fairness of admissions policies > .Are some grdups discriminated 
\ against "by a marks-based system? 
o , The broader role of the Ideology of merit ; Are marks a facade for 
an unjust 'system of social stratification? , ' 
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.In*1950, J.M/Stalnaker, director of a medical school testing project, noted 
that the MCAT test for admissions was not aimed so much at predicting performance 
as to assess the knowledge and intellectual skills considered to be desirable in. 
a physician, "While I should be unwilling to discourage anyone from correlating 
any two variables, I can neither be impressed nor concerned when a low correlation 
fs found between scores on a test in understanding modern society and grades in 
laboratory work in gross anatomy. I continue to favour selecting the men for 
the study of medicine who have some awareness of the social sciences." Stalnaker, 
"Tests for Medicine," Proceedings 1950 Invitational Conference on Testing Prob- . 
lems. Educational Testing Service, Princeton, 1951, p. 50. 



